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Abstract 

In this paper we prove maximal inequalities and study the functional central 
limit theorem for the partial sums of linear processes generated by dependent 
innovations. Due to the general weights these processes can exhibit long range 
dependence and the limiting distribution is a fractional Brownian motion. The 
proofs are based on new approximations by a linear process with martingale 
difference innovations. The results are then applied to study an estimator of the 
isotonic regression when the error process is a (possibly long range dependent) 
time series. 

1 Introduction and notations 

Without loss of generality, we assume that all the strictly stationary sequences 
(&)iez considered in this paper are given by = £o ° T % where T : Q i— * fi is a 
bijective bimeasurable transformation preserving the probability P on (O, A). 
We denote by I the er-algebra of all T-invariant sets. For a subfield Tq satisfying 
To C T-\F ), let Ti = T-\T a ). Let T-^ = n„> ^-» and ^ - V fee z^fc- 
The sequence (^Fi)igz will be called a stationary filtration. We assume also that 
£o is regular, that is E^ol-^-oo) = and £o is .Foe-measurable. On L 2 , we define 
the projection operator Pj by 

P j (Y) = E(Y\f j )--E(Y\f j _ 1 ). 

For any random variable Y, \\Y\\ p denotes the norm in L p . 

Recall that the linear process = X^iez a i£,k-i is well defined in L 2 for 
any (oi)jgz i n ^ 2 (i- e - IZiez a i < 00 ) ^ ano - only if the stationary sequence 

1 Supported in part by a Charles Phelps Taft Memorial Fund grant and NSA grant, H98230- 
09-1-0005. 



(£i)iez has a bounded spectral density. Let S n = Xi + ■ ■ ■ + X n and c nj - = 
ai_j + • • • + a n -j- In the case where £o is .Fo-measurable, Peligrad and Utev 
(2006-b) have proved that if the sequence (£i)i G z satisfies an appropriate weak 
dependence condition, then 

converges in distribution to ^JfjN where r\ is a positive X measurable random 
variable, and N is a standard normal random variable independent of r\. Their 
result extends the classical result by Ibragimov (1962) from i.i.d &'s, to the case 
of weakly dependent sequences. In particular, the result applies if 

^||Pote)ll2<oo. (1) 

Note that if this condition is satisfied, then the series X^fcez |E(£o£fc)l converges, 
and 77 V,. z K(^./i. 

Condition ([TJ) has been introduced by Hannan (1973), and by Heyde (1974) 
in a slightly weaker form, and is well adapted to the analysis of time series 
(see in particular the application to time series regression given in the paper 
by Hannan (1973)). As we shall see in our Remark 13. 3[ Condition |T]) is also 
satisfied if 



oo oo - 

V — ||E(C„|^o)|| 2 < oo and V -=\\^ n - E(£_„|^ ) 



| 2 <oo, (2) 



which is weaker than the condition introduced by Gordin (1969). If £o is 3~o- 
measurable, the condition ^ leads to new interesting conditions for weakly 
dependent sequences, and can be successfully applied to functions of dynamical 
systems (see Section 3 in Peligrad and Utev (2006-b), and Section 6 in Dedecker, 
Merlevede and Volny (2007) for more details). 

A natural question is now: what can one say about the weak convergence of 
the partial sum process 

{(E c L)~ 1/2 ^]'* e [0 ' 1] } (3) 

iez 

in the space D([0, 1]) of cadlag functions equipped with the uniform topology. 
Since the paper by Davydov (1970) for i.i.d £j's, we know that the question is not 
as simple as for the central limit question, and that the limiting process (when 
it exists) depends on the behavior of the normalizing sequence — X^ez c n y 
More precisely if |T]) holds, and if there exists (3 s]0, 2] such that 

v 2 

for any t G]0, 1] lim -M = , (4) 

n— >oo v 
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we show in Theorems 13.11 and 13.21 that the finite dimensional marginals of the 
process (|3]) converges in distribution to those of ^Jt^Wh where Wh is a fractional 
Brownian motion independent of 77, with Hurst index H = 13/2. The question 
is now: under what conditions can one obtain the tightness in D([Q, 1]). 

In Theorem 13. II of Section |3~TI we show that if (3 €]1,2], then the condition 
|T]) is sufficient for the weak convergence in D([Q, 1]). If (3 G]0, 1], we point out 
in Theorem 13.11 that the convergence in D([0, 1]) holds if (p} is replaced by the 
stronger condition 

^||P Q te)|| g <oo iorq>2/(3. (5) 

As a matter of fact, for f3 = 1, it is known from counter examples given in 
Wu and Woodroofe (2004) and also in Merlevede and Peligrad (2006) that if the 
sequence (£i);ez is i.i.d. with E(£q) < 00, then the weak invariance principle 
may not be true for the partial sums of the linear process, so that a reinforcement 
of is necessary. The case (3 — 1, where W1/2 is a standard Brownian motion, 
is of special interest, and is known as the weakly dependent case. In that case, we 
point out in Sect ion [32] that if we make some additional assumptions on (ai)jgz, 
then the condition (1) is sufficient for the weak invariance principle (Comments 
I3.1l and l3.2|) , or may be reinforced in a weaker way than (JSJ) (Theorem 13.31) . 

Note that, with the notations above, the sum S n may be written as 

S n = ^ c n,i£,i- (6) 

iez 

Consequently, to prove our main theorems, we give in Section[2]two preliminary 
results for linear statistics of type (J6j) : first a moment inequality given in Propo- 
sition [2Tj and next a martingale approximation result given in Proposition ^. 21 
which enables to go back to the standard case where the £j's are martingale 
differences. Both results are given in terms of Orlicz norms. 

Our results provide, besides the invariance principles, estimates of the max- 
imum of partial sums that make them appealing to study statistics involving 
linear processes. In Section 0] we apply our results to the so-called isotonic 
regression problem 

vk = K~) + Xk ' k= x > 2 > •••>"> ( 7 ) 

where cj) is non decreasing, and the error Xk is a linear process. We follow the 
general scheme given in Anevski and Hossjer (2006), who showed that in the 
context of dependent errors, the main tools to obtain the asymptotic distribu- 
tion of the isotonic estimator </> are the convergence in D([0, 1]) of the partial 
sum process defined in ([3]), and a suitable maximal inequality. As in Anevski 
and Hossjer (2006), the rate of convergence of <f> is determined by the asymp- 
totic behavior of the normalizing sequence v\ — X)jez c nj' an( ^ ^ ne limiting 
distribution depends on the limiting process Wu- 
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2 Moments inequalities and Martingale approx- 
imation for Orlicz norms 

Let us introduce the following class of functions (see page 60 in de la Pena and 
Ginc (1999)). For a > 0, the class A a consists of functions $ : R + — > R + , 
$(0) = 0, $ nondccrcasing continuous and 

$(cx) < c Q $(x) for all c > 2, x > . 

Now for any convex function ^ in A a , we denote by Lif the Orlicz space defined 
as the space of all random variables X such that EW(|X|/c) < oo for some c > 0. 
It is a Banach space for the norm, 

\\X\\a, = inf{c > 0, E*(|X|/c) < 1}. 

Note also that when %f(x) = x q , 1 < q < oo, then L# = L 9 . 

Proposition 2.1 Let {Yfcjfcez be a sequence of random variables such that for 
all k, E(Yfe|J F _ 00 ) = almost surely and is Too-measurable. Let ^ be a 
convex function in A a such that x ^> ^(y/x) is a convex function. Assume that 

oc 

||Pfc-j(Yfc)||# < Pj and D ^ '■= X] Pj <0 °- 

j=-oo 

For any positive integer m, let {c m ,j}jez be a sequence in £ 2 . Define S rn = 
Sjez c m,jYj- Then for all m > 1, there exists a positive constant C a depending 
only on a such that 

\\S m y<C a D 9 (j2^ nJ ) 1/2 . (8) 
jez 

Remark 2.1 Under the notations of the above lemma, we get for the special 
function \P(x) = x q with q G [2, oo[, the following moment inequality. Assume 
that 

oo 

\\Pk-j(Y k )\\ g < Pj and D q := ^ ft < oo . 

j=—oo 

Then, for any m > 1, 

\\Sm\\ q <C q (j2 c2 m,o) 1/2D ^ 

jez 

where C\ = 18q 3 / 2 /( 9 - l) 1 / 2 . 

For all j € Z, let dj = X^ez Clearly (dj)j e z is a stationary sequence 

of martingale differences with respect to the filtration (Fj)jez- 
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Proposition 2.2 For any positive integer n, let {c nt i}i^z be a sequence in £ 2 . 
Let ^ be a convex function in A a such that x ^— > *&(y/x) is convex. Assume 
that £o £ L^j. IfJ^j^z ll^b(Ci)ll* < 00 then we have the following martingale 
differences approximation: for any positive integer m, there exists a positive 
constant C a only depending on a such that 



iSZ iGZ |fc|>m 

1 /2 

+3C Q ,m( y^(c 

) 2 En p ofe)ii 

* ■ 



Corollary 2.1 Lei (<Xj)jgz &e « sequence of real numbers in £ 2 . Let \& be a 

convex function in A a such that x <— > ^(s/x) is convex. Assume that £0 G Lq, 
and J2j ll-Po(Cj)lk < 00 • Let x k = >J r Z ";i7 , ifc = >J ,.. z ".,'/»•• Se£ 
S n = Sfc = i -^fe = 2fc=i^fc- Then for any positive m, there exists 

positive constants C\ and C2 such that 

||5 n -T„||* <dv 2 n \\Po{tk)h + C 2 m, (9) 



\k I > m 



where v 2 = J2jez c n,j> an d c n,j = ai-j +••■ + a n - 3 . 

Proof of Corollary 12.11 We apply Proposition 12 . 21 by noticing that S n — T n 
J2jez c «j (6 - d i) and tnat 



E( c «j - c «j-i) 2 ^ 4 E 

jez jez 



s 2 



Using the Orlicz norms, we give the following maximal inequality which is a 
refinement of Inequality (6) in Proposition 1 of Wu (2007). 

Lemma 2.1 Let ip be a convex, strictly increasing function on [0, oo[ with < 
\l/(0) < 1. Let p > 1 and write ^ P (x) for ^(x p ). Let (i^)i<j<2 JV be a strictly 
stationary sequence of random variables such that ||Yi||* < 00. Let S n — 
Y 1 + --- + Y n . Then 



max I Sn 

Km<2 N 



< 

P 



N 1/ 

^2\\S 2 ^ P (^- 1 (2 N - L )) ,P . 



L=0 



Remark 2.2 Clearly we can take ^S(x) = x in Lemma \2.1\ Hence, in the 
stationary case, we recover relation (6) in Wu (2007). 
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3 Invariance principle for linear processes 



In this section we shall focus on the weak invariance principle for linear processes. 
Let (ai)i 6 z be a sequence of real numbers in i 2 . Let 

[nt] 

X k = ^a 4 6c- 4 and S[ nt ] = ^X k , (10) 
iez fe=i 

and 

v„ =y^c^ ? -, where c n j = ai-j H V a n -j . (11) 

iez 

The behavior of the process {Swwi G [0,1]}, properly normalized, strongly 
depends on the behavior of the sequence (aj)jez- 

In the two next sections we treat separately the case where the limit process 
is a mixture of Fractional Brownian motions from the case where it is a mixture 
of standard Brownian motions. 



3.1 Convergence to a mixture of Fractional Brownian mo- 
tions 

Definition 3.1 We say that a positive sequence {v n ) n >i is regularly varying 
with exponent (3 > if for any t (E]0, 1], 

^-t* as n^oo. (12) 

v 

We shall separate the case (3 2] from the case (3 e]0, 1]. 

Theorem 3.1 Let (aj)j e z in i 2 ■ Let (3 €]1,2] and assume that defined by 
is regularly varying with exponent f3. Let £o be a regular random variable 
such that ||£o||2 < °°, an d ^et £i = Co°T*. Assume that condition (QP is satisfied. 
Then the process {v~ 1 S[ nt ] , t € [0, 1]} converges in D([Q, 1]) to y/rjWu where Wh 
is a standard fractional Brownian motion independent of rj with Hurst index 
H — (3/2, and r\ = X^fcez ^(£o£fc \£) an d there exists a positive constant C (not 
depending on n) such that 

E( max S 2 ) < Cv 2 n . (13) 

l<k<n 

Theorem 3.2 Let (3 €]0, 1] and assume that v 2 ^ defined by is regularly vary- 
ing with exponent (3. Let £o be a regular random variable such that ||£o||2 < oo, 
and let £j = ^oT*. Assume that condition {!]) is satisfied. Then the finite 
dimensional distributions of {v~ S\ n f\,t £ [0,1]} converges to the corresponding 
ones of ^/rjWn , where Wh is a standard fractional Brownian motion indepen- 
dent of rj with Hurst index H = (3/2, and r\ = X^fcez ^(CoCfcl^)- Assume in 
addition that for a q > 2/(3 we have ||£o||g < °o and 

£||P fo)l| 9 <°o. (14) 
jez 
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Then the process {v n 1 S[ nt ],t G [0, 1]} converges in D([0, 1]) to y/rfWH and \13\) 
holds. 

Remark 3.1 According to Corollary 2 in Pcligrad and Utev (2006-b), one has 
ton = Hm Y^1±^±M = v > = II Vp ofe .) 2 . 

Remark 3.2 In the context of Theorem \3.1l condition \12\l is necessary for 
the conclusion of this theorem (see Lamperti (1962)). This condition has been 
also imposed by Davydov (1970) to study the weak invariance principle of linear 
processes with i.i.d. innovations. 

Example 1. Let us consider the linear process Xk is defined by 

X k = (l-B)-% = yW fc -i with a t = , (15) 

where < d < 1/2, B is the lag operator, and (^)iez is a strictly stationary 
sequence satisfying the condition of Theorem 13.11 In this case Theorem 13.11 
applies with (3 = 2d + 1, since a k ~ Kdfc d_1 for some K4 > 0. 

Example 2. Now, if we consider the following selection of (afc)fc>o: do = 1 and 
Oj = (i + l)~ a — i _Q for i > 1 with a g]0, l/2[, then Theorem [XU applies. Indeed 
for this selection, , where positive constant depending on 

a. 

Example 3. For the selection ~ i~~ a l(i) where £ is a slowly varying function 
at infinity and 1/2 < a < 1 then, v\ ~ K Q n 3 ~ 2Q £ 2 (n) (see for instance Relations 
(12) in Wang et al. (2003)), where k„ is a positive constant depending on a. 

Example 4. Finally, if <2j ~ i _1 ' 2 (logi) _a for some a > 1/2, then v 2 ~ 
n 2 (logn) 1 ~ 2Q /(2a - 1) (see Relations (12) in Wang et al. (2003)). Hence (H]) 
is satisfied with (3 = 2. 

For the sake of applications, we now give a sufficient condition for (fl4|) to 
hold. 

Remark 3.3 For any q £ [2,oo[, the condition \1J$ is satisfied if we assume 
that 

E^H^I^II^ 00 and £^i77llC-n-E(e-r,|Ji))|| 9 <oo. (16) 

n— 1 n— 1 

The fact that (fTB]) implies (fT4")l extends Corollary 2 in Pcligrad and Utev 
(2006-b) and also Corollary 5 in Dedecker, Merlevede and Volny (2007) from 
the case q — 2 to more general situations. 

For causal linear processes, Shao and Wu (2006) also showed that the weak 
invariance principle holds under the condition (|14|) as soon as the coefficients of 
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the linear processes satisfy a certain regularity condition. To be more precise, 
their condition on the coefficients of the linear processes lead either to f3 > 1 or 
to < 1. For this last case, they specified the coefficients (ai)i> as follows: for 
1 < a < 3/2, aj = j~ a £(j) for j > 1 (where £(i) is a slowly varying function) 
and Y^jLo a i ~ ( see ^ or instance their Lemma 4.1). For this selection, 
is regularly varying with coefficient (3 = 3 — 2a < 1. Our Theorem 13.21 does 
not require conditions on the coefficients but only the fact that the variance is 
regularly varying which is a necessary condition. 

3.2 Convergence to a mixture of Brownian motions 

The case (3 = 1 deserves special attention. For this case the limit is a mixture 
of Brownian motions. 

As an immediate consequence of Theorem 13.21 we formulate the following 
corollary for causal linear processes, under a recent condition introduced by Wu 
and Woodroofe (2004). 

Corollary 3.1 Let £o be a regular random variable such that ||£o||g < 00 f or 
some q > 2, and let = (o o T l . Assume in addition that 

£||P &)||,<°°. (17) 

Let (cii)iez be a sequence of real numbers in £ 2 such that ai = for i < 0. Let 
bj = aa + ■ ■ ■ + aj . Define (Xk)k>i as above and assume that 

n-l 

b\ — * oo, as n — * oo, (18) 

fe=0 

and that 

oo n— 1 

E( 6 ^-^) 2 = °(E^)- as) 

j=0 fc=0 

Then w„ ~ nh(n), where h{n) is a slowly varying function. Moreover, the pro- 
cess {v^Sintfjt € [0, 1]} converges in D([0, 1]) to y^rjW where W is a standard 
Brownian motion independent of n, and r\ — ^2 keZ E(£o£fc|^)- In addition U3\) 
holds. 

To prove this result, it suffices to apply Theorem 13.21 and to use the fact 
that under (p]) and ((TSJ), vl - nh{n) (see Wu and Woodroofe (2004)). Un- 
der the same conditions (fT8]) and (fT9|) . Wu and Min (2005, Theorem 1) have 
also proved the weak invariance principle but under the stronger condition 
Si^oill-foCC/)!!? < 00 ( m their paper the random variables £j are adapted 
to the filtration Tj). 

Remark 3.4 The above result fails if in |i7| ) we take S = 0. <5ee Woodroofe 
and Wu (2004) an d a ^ so Merlevede and Peligrad (2006, example 1 p. 657). 
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Let us make some comments on the case where the condition (JXJ) is sufficient 
for the weak convergence to the Brownian motion, with the normalization s/n. 
The first case is already known, and the second case deserves a short proof. 

Comment 3.1 When X)iez l a *l < 00 > short memory case) and condi- 

tion (Jll is satisfied one can use the result from Peligrad and Utev (2006-a) in 
the adapted case, showing that the invariance principle for the linear process 
is inherited from the innovations at no extra cost. For this case, the process 
{rz. -1 ' 2 S'r nt ] , t G [0, 1]} converges in distribution in -D([0, 1]) to ^/rfW , where W 
is a standard Brownian motion independent of n and r\ — A 2 X^feez E(£o£fc|^") 
with A = J2i£z a i- Moreover E(maxi<fe<„ S^) < Cn 2 . See Dedecker, Merlevede 
and Volny (2007), Corollaries 2 and 3 for the nonadapted case. 

Comment 3.2 Let {ai)i e z in I 2 and assume that the series Xiez a i converges 
(meaning that the two series X)i>o ai an< ^ ^2i<o a i converge), and the Heyde's 
(1975) condition (H) holds 



2 2 

(h) ^2 ( X] ak ) < 00 and ^2 ( ak ) < °° • 

k>n n=l fc< — r 



Assume also that condition (QJ) is satisfied. Then the same conclusion as in 
Comment \3.1\ holds. 

Example 5. The Heyde's condition allows the following possibility: J2iez \ ai \ = 
00 but X)iGZ a « converges. For instance, if for n < 0, a n = 0, and for n > 1, 
a n = (— l) n u n for some sequence (tt n )n>i of positive coefficients decreasing 
to zero, such that X)n>i u « = 00 j then Condition (H) is satisfied as soon as 
S n >o u n < 00 ) which is a minimal condition. It is noteworthy to indicate that 
the Heyde's condition implies (|19|) . 



Now, if Xjez \ a j\ ~ 00 an< ^ {H) does not hold, condition (fT7|) may still be 
weakened in some particular cases. The following result generalizes Corollary 4 
in Dedecker, Merlevede and Volny (2007) to the case where the innovations of 
the linear process are not necessarily martingale differences sequences. Denote 

by 

= a i) ■ ( 2 °) 

i=—n 

Theorem 3.3 Let (aj)jgz be a sequence of real numbers in £ 2 but not in I 1 , 
and let s^ be defined by i20\) . Define (Xk)k>i as above and assume that 

limsup ■ - < 00 and / a 2 = o(s n ) . (21) 



En 
1 
i=— n 



fc=i y |i|>fc 



If one of the two following conditions holds 
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(a) V" 11^0(^)11*2.,, < oo, where ^i, a {x) = x 2 log Q (l + x 2 ) and a > 2. 
jez 

or 

r6;^log(l + |i|)||P fe)ll2<cx) , 

then {s~ S\ n tut G [0,1]} converges weakly in D([0, 1]) to y/rjW , where W is 
a standard Brownian motion independent of rj and rj — X^feez E(£o£fc|^)- In 
addition, there exists a positive constant C (not depending on n) such that 

E( max Si) < Cs 2 n . (22) 

l<k<n 

Remark 3.5 For two positive sequences of numbers the notation u n ~ v n 
means that linin^oo u n /v n — 1. According to Remark 12 in Dedecker, Mer- 
levede and Volny (2007), we have that 

s l~ v l~ nh ( n ) » 

where h(n) is a slowly varying function at infinity. In addition if we assume 
the first part of Condition (21\) and X^ez l a il = 00 > we 9 e ^ s ™/ 'V™ ~ * °°> 
as n — ► 00. 

Example 6. If we consider the following selection of (at)kez'- clq = 1 and dj = 
l/|i| for i ^ 1, then Theorem 13.31 applies. Indeed for this selection, Condition 
(|2"Tj) holds and s n ~ 2- v /n(logn). 

We give now a useful sufhcient condition for the validity of condition (b) of 
Theorem 13.31 



Remark 3.6 The condition (b) of Theorem \3.S\ is satisfied if we assume that 
> logn = < 00 and > logn = < 00. (23) 

n— 1 v n— 1 v 



4 Application to isotonic regression 

Let be a nondecreasing function on the unit interval and let 

y k = <t>(~) + X k , fc = l,2,...,n. (24) 

where (X&) is a strictly stationary sequence of random variables such that 
E(Xfe) = and E(X|) < 00. The problem is then to estimate <f> nonpara- 
metrically. We denote by S n = J2t=x ^k- 

Taking advantage of the monotonicity of the regression function, isotonic 
estimates are well appropriated. Let (if. — cf>(k/n). It is well known that the 
least square estimator 

n 

/tfc = argminj J^(?/fc - Mfc) 2 ,Mi < < A*™}, 

k=l 
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is equal to 

. U i H h 

/ifc = max mm — : : - 

i<fe j>fe j — i + 1 

In addition, setting 



1 / [ " t] V 

r « w = - ( E w*) and y » = GCM ( Y n) ■ 



k=l 

where GCM designates the Greatest Convex Minorant, then 



Y! 



where the derivative in taken on the left (see Robertson, Wright and Dykstra 
(1988)). Let now 4>n{) be the left continuous step function on [0, 1] such that 
<f) n (k/n) — pik at the knots k/n for k = 1, . . . ,n. 

The aim of this section is to derive the asymptotic behavior of 4> n (t) when Xk 
is a linear process which can exhibit short or long memory As it is indicated in 
Anevski and Hossjer (2006) and in Zhao and Woodroofe (2008), the two main 
tools to obtain the asymptotic behavior of <f> n (t) are first a weak invariance 
principle for the partial sums process {S\ n t],t <E [0, 1]} properly normalized, and 
a suitable moment inequality for maxi<fc< n S%. 

Theorem 4.1 Let (<z,)igz and (£i)»6Z be as in Comments \3.1\ or VS.'A. Let us 
consider the model \2J$ with Xk defined by U0\) . For any t € (0,1) such that 
cf>'(t)>0, 

n l ' 3 n- l {j) n {t) - 4>{t)) => (^) 2/3 argmin{S(s) + s 2 , s € R} , 

where B denotes a standard two-sided Brownian motion independent of n, rj = 
E fce z E(Co&|2), and k = 2(§AV(f)) with A = J2 jeZ a*. 

Let /3 e]0, 2], and let h be a slowly varying function at infinity. Let now 

and notice that L(x) is also is a slowly varying function at infinity. Denote then 
by L* the asymptotically conjugate of L, which means that L* satisfies 

lim L*{x)L{xL*{x)) = 1. (26) 

Define then 

d « = n( 2-0W-0) e ( n ) Where ^ = ( L * (")) V{i ~ 0) ■ ( 2? ) 
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Theorem 4.2 Let (dj)iez an d (£i)iez &e as m Theorem \3.3\ For (3 — 1 and 
h(n) = | 5Z"__ n a,;| 2 , Ze£ d„ 6e defined by \2ty . Let us consider the model {2J$ 
with Xk defined by iltfy . For any t G (0, 1) such that <fr'(t) > 0, 

d^K^iMt) - 0(t)) => (0?) 2/3 argmin{ J B(s) + s 2 , s G R} , 

where B denotes a standard two-sided Brownian motion independent of r\, n — 

£ feeZ E(&& \T) , and k = 2 (\<t>'{t)) ^ . 

Theorem 4.3 Let (ai)i^z o,nd (£i)igz be as in Theorem \3.1\ or \3.2[ for some 
(3 €]0,2[. By assumption, v 2 defined by is regularly varying with exponent 
f3. For this (3 and for h(n) = t> 2 n~' 3 , let d n be defined by \27^ . Let us consider 
the model \2J$ with Xk defined by Then for any t G (0, 1) such that 

cf>'(t) >0, 

dn'^HMt) - <t>(t)) => (Vv) 1/{2 ' H) ^gmm{B H (s) + s 2 , s G M} , 

where Bh denotes a standard two-sided fractional Brownian motion independent 
of n, with Hurst index H = (3/2, n = ^2 k ez E(£o£fe|^)> and the constant is 
given by up = 2{<p / (t)/2) ( - 2 -W ( - 4 -Pl 

Proofs of Theorems 14.11 14.21 and 14.31 For any t G (0,1) and any s G 
[-td-^d-Hl-t)}, let 

Z n (s) = d- 2 (Y n (t + d„s) - Y n {t) - (p(t)d„s) . 

Then d" 1 (<?(>„ (i) - (j>{t)) = Z' n (0), the left hand derivative of the GCM of Z n at 
s = 0. Hence the key for establishing the result is the study of the GCM of the 
process Z n . This can be done by following the arguments given in the Section 
3 of the paper by Anevski and Hossjer (2006), and also in the paper by Zhao 
and Woodroofe (2008). More precisely, a careful analysis of the proofs given in 
both papers shows that the following lemma is valid. 

Lemma 4.1 Assume that there exists a positive sequence m n — > oo satisfying 
for any t > 0, 

m[ nt ]/m n — > t H where H G]0, 1[, (28) 

and such that 

1. The process {m^S^^t G [0, 1]} converges in D([0, 1]) to ^/t]Wh, where 
n is a positive random variable and Wh is a standard fractional Brownian 
motion ( with Hurst index H ) independent of r\, 

2. E(maxKK„^) < Cm 2 . 

Then, for any positive sequence d n — > such that nd n — > oo and d~ 2 n~ 1 m^ nl i r ^ 
1, and for any t G (0, 1) such that <fi'{t) > 0, 

d^Kff (&.(*) - 4>(t)) => (V^) 1/(2 ~ H) argmin{B H (.s) + s 2 , set}. 

where Bh(.) denotes a standard two-sided fractional Brownian motion indepen- 
dent ofn, with Hurst index H G]0, 1[, and k h = 2{ct>'(t)/2)V-- H W- H \ 
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We would like to mention that in order to use the continuous mapping the- 
orem, the processes have to be corrected in order to be continuous. This can 
be done easily since if Item 1 above holds then necessarily maxi<i<„ Xi/m n 
converges to zero in probability. 

To finish the proofs, we notice that the conditions of Items 1 and 2 are 
clearly satisfied by using either Comment 13.11 or 13.21 (with m n — y/n), either 
Theorem l3.3l fwith m n — y/n\ J2?=- n a *l) or Theorem l3 . 1 1 or [3~2l (with m n = v n ). 
In addition, in all these situations, we have that m n — (n /3 /i(n)) 1 / 2 and the 
selection of d n leads to 

~ (r(n)) _ y/i((ni*(n)) 2 /( 4 -' 3 )) 
~ (L*(n))-\L(nL*(n)))-\ 

which converges to 1 by (|26|) . 



5 Proofs 

5.1 Proof of Proposition 12. ll 

Without restricting the generality we shall assume = 1 and Y^jez c m.j = 1j 
since otherwise we can divide each coefficient c m ,j by (J2jez c m,j) 1 ^ 2 an d each 
variable by D^. Start with the decomposition 

oo oo 

Y k = Pk-j(Y k )= Yl PiPk-i(Yk)/Pj . 

j=— oo j=— oo 

Then 

OO 

S m = ^ P i X! c in,kPk-]{Yk)/P] ■ 
j— — oo feeZ 

By using the facts that \& is convex and non-decreasing, and pj > with 
YljzzPj = = 1, we obtain that 

oo 

j — — oo fc€Z 

Consider the martingale difference C/fc = c m! kPk—j(Yk)/Pj , k € Z. By Burkholder's 
inequality (see Theorem 6.6.2. in de la Pefia and Cine (1999)), we obtain that 

E¥(| ]T c m , k P k ^(Y k )/ Pj \) < K a m(Q2 ^kPk-jiYkW^ 2 ) , 
kez feez 
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where K a is a constant depending only on a. Let = ty{yfx). Since $ is 

convex and J2kcz c m k ~ 1> ^ follows that 

feez feez 

feez 

< K a ^& ik Emi\-j(Yk)\/Pi))- 
feez 

Therefore 

OO 

E*(|S m |)<X a $> m , fc J2 PjE(*(|J\-i(lfc)|/Pi)) 
feez j— — oo 

Now notice that ||Pfc_j(Yfe)||* < pj, hence using the fact that X^feez c m fe = 1 
and = Y^-oo Pi = 1> we § et tnat 

E*(|S m |) <X a , 

and so the desired result. o 

5.2 Proof of Proposition 12.21 

Fix a positive integer m and define 

2m-2 ra-l 
fe— fc— m+1 

Observe that, by stationarity, 

2m-2 m-1 

Hflb.mll* = II Z Z ^ 2 ™ZH P °^)II* < 00 ' 

fe=0 i=fe— m+1 ieZ 

Simple computations lead to the decomposition 

771—1 2777—1 

j=-m+l £=1 

implying that 

£o - *b(&)) o T m = 0o : ,77 - fli, m + P ^o) - ( Z P °(6)) ° 7 1 ™ . 

k |z|>m |fe|>m 

With our notation (do = J^ fc Po(£&) )j we obtain 

CO - d - d O I™ - d + 00,777 " #1,777 + P ifa) - ( Z P °(^)) ° TTO - 

|i|>m |fe|>m 
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By stationarity we obtain similar decompositions for each £j — dj . We shall treat 
the terms from the error of approximation °n,i(£i ~ ^») separately. First 

notice that 

oc oo rn— 1 oo 

j — — oo i =— 00 /c=0 j — — oo 



According to Proposition [2711 

00 

||i?l||* < C a m\\d \\*( E (Cn,i - Cnj-l) 2 ) 172 • 
j=— oc 

To treat the second difference in the error, notice that 

00 00 

i— — oo i— — oo 

By the definition of 9o, m we have that 

2m-2 m-1 

En p i(^)ik< E E En p i(^(^))ii*- 

jez fc=o i=fc-m+ijez 

Now Pj(Pi(f)) = for j ^ i. It follows that 

2 m— 2 TTi—l m— 1 

En p i(^,m)ik< E E 11^0(6)11* < (2m -1) E n p o(&)ii*> 

jeZ fc=0 f=fc-m+l £=-ra+l 



and by Proposition 12.11 we conclude that 

oo 

<2C a m( E Ki-c^-if^EH^^)!!*- 
j=-oo £ez 

For the term R 3 := S£-oo ^(Eli^m P j(£o)) ° Z 1 ' we apply Proposition O 
to get 

oc 

\\R 3 \\*<c a ( e cD 1/2 E n^-(&)ik. 

"i— — oo 

To deal with the last term R 4 := X^-co c n,*(I]|fc|>m Po(€k)) T m+? , we apply 
again Proposition ^. 1[ which gives 



HiZ4ii*<c tt ( E c h) 1/2 E n p o(a)ik- 

i= — oo \k\>m 

Combining all the bounds we obtain the desired approximation. o 
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5.3 Proof of Lemma 12.11 

For any m £ [1, 2^], write m in basis 2 as follows: 



N 

m = 

i=0 



bi(m)2 l , with bi{m) = or 6j(m) = 1 



Set tol = bi(m)2 l . So for any p > 1, we have 

JV 

|5m| P < ^ \Sm L — S mL + 1 

L=0 



Hence setting 



"l = l-^w-l (* '(2' v '•)) 1/P audA,, = r ^ 



we get by convexity 

N 

\S m \ p < A L ^l-S'mj^ — 5' mii+1 | p . 

L=0 

Now rriL ^ tol+i only if 6i(m) = 1, and in that case mi = k m 2 L with fc m odd. 
It follows that 

N 

max |S" m | p < V A^" p max |5 fc2 z, - SV fc _i) 2 £ | p . 

Km<2 f— ' Kfc<2 JV -- L ,fc odd 1 ; 

Now, we apply Lemma 11.3 in Ledoux and Talagrand to the variables 

\^k2 L — ^(k— 1)2 L 1^ 

Z k = — , with A = \\S 2 l\\m, p , 

and to the Young function Since 

E(¥(Z fc ))=E¥ p (J^i)<l, 
and since is concave, we see that for any measurable set B, 



E(^1 B )<P( J B)*" 1 (— l — 



so that the assumptions of Lemma 11.3 in Ledoux and Talagrand (1991) are 
satisfied. It follows that 

E( max \S k2 , - S {k _ 1)2 L | p ) < A^-\2 N ~ L ). 

\ l<k<2 N ~ L ,k odd v 1 J 

Finally, we conclude that 

N 

E( max \S m \ p ) < ( V a L 

- - L=0 

which is the desired result. o 



16 



5.4 Proof of Theorems HD and EO 

By the weak convergence theory of random functions, it suffices to establish 
the convergence of the finite dimensional distributions and the tightness of 
{w~ 1 S'[ rlt ], t £ [0, 1]}. For the finite-dimensional distribution we shall use the fol- 
lowing proposition which was basically established in Pcligrad and Utev (1997, 
2006-b). 

Proposition 5.1 Let {S,k\kez be a strictly stationary sequence of centered and 
regular random variables in L 2 such that yV 1 1 -Fb (Cj ) 1 1 2 < oo. For any positive 
integer n, let — oo < i < oo} be a triangular array of numbers satisfying 



b\ i — ► 1 and \ (b n j — b n j-i)' 2 — > as n — ► oo , (30) 



and 



sup \b n> j\ — > as n — > oo . (31) 



Then {S n = ■ frn.j£j} converges in distribution to y/fjN where N is a standard 
Gaussian random variable independent of r\, and rj — J2kez ^(CoCfel^)- 

Proof of Proposition 15. li We give here the proof for completeness. By 
using Proposition 12.21 it suffices to prove this proposition with dj = do o T l in 
place of £j , where do = yj ■ -Po(£j)- Hence we just have to apply the central limit 
theorem for triangular arrays of martingales (see Theorem 3.6 in Hall and Heyde 
(1980)). The Lindeberg condition has been established by Peligrad and Utev 
(1997) provided that (|3"Tj) and the first part of condition (|30l) are satisfied. Now 
in the proof of their proposition 4, Peligrad and Utev (2006-b) have established 
that (l30|) implies that 

b 2 n jd 2 — > r\ in probability as n — > oo, 

3 

which ends the proof of the proposition, o 

We return to the proof of Theorems 13.11 and 13.21 To prove the convergence 
of the finite dimensional distributions, we shall apply the Cramer- Wold device. 
For all integer 1 < £ < m, let ni = [ntf] where < t\ < ti < ■ ■ ■ < t m < 1. For 
Ai, . . . , A m £ R, notice that 

Em \ n m . 

Vn jez e=i Vn 

where c nj = a\-j + • • • + a„_j for all j £ Z, and v\ — J2j^z c n.j- Let 

1 171 \ 
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where 

1 m 



2 

t,k=i 

We apply Proposition 15. II to b n j and the £j's denned as A TOi/ g£j-. We have first 
to calculate the limit over n of the following quantity 

E,2 1 SjeZ 2^=1 Sfe=l ^l^k^ne jC nt j 

For any 1 < I < A; < m, by using the fact that for any two real numbers A and 
B we have A(A + B) = l/2(A 2 + (A + B) 2 - B 2 ), we get that 



„2 E CntJCnxJ ~ 2 V 2 ^ 

— r 



■'. / , "<•- "<•- .),.'-' / ( C ™«J C ™fcj' ( C "«J C "fcj) ) 

' " j'ez n iez 



2,2 _ 2 \ 

By using now the condition (112p . we derive that, for any 1 < £ < k < m, 

— — - 2 ► + -(**-*<)*)■ (34) 

It follows from flM} that 

lim^6^. = l. (35) 
iez 

As a consequence the first part of condition (|3"0")) holds. On an other hand, 
by using Lemma A.l in Peligrad and Utev (2006-b), the second part of the 
condition (f3"0"| is satisfied. Now by the proof of Corollary 2.1 in Peligrad and 
Utev (1997) we get that 

v„ 

which together with (fT2"]) implies (|3"Tj) . Applying now Proposition 15. 11 we derive 
that 



converges in distribution to A mj /3s/rjN , 



ending the proof of the convergence of the finite dimensional distribution. 

We turn now to the proof of the tightness of {v~ 1 S[ nt ], t e [0, 1]}. By using 
Proposition ^. 11 we get for q > 2 that 

1 /2 

l|S fc || 9 <C 9 (XX-) E ll^o(U)ll 9 = <> fc ^ ||Po(UII 9 , (36) 
jez mez mez 

provided that X^mez ll-fb(£m)llg < °°- Therefore the conditions of Lemma 2.1 
p. 290 in Taqqu (1975) are satisfied with q > 2/(3, and the tightness follows. 

Finally to prove (fL3|) . we use (|36|) together with Lemma [2.11 applied with 
ip(x) = x by taking into account that v 2 ^ is regularly varying with exponent (3. 

o 
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5.5 Proof of Remarks [3J3] and SH 

To prove Remark 13.31 we apply lemma 16.11 from the appendix with 6^ = 1 and 
Ui = \\P-i{io)\\ q . Hence we get 

oo oo oo i 

E w p -^\\, < c q e {k £ n p -^°)H*) 9 • 

n—1 n—1 fc— n 

Applying the Rosenthal's inequality given in Theorem 2.12 in Hall and Heyde 
(1980), we then derive that for any q € [2, oof, there exists a constant c q de- 
pending only on q such that 

oo oo 

E P-*Ko)H2 < M E P -*(£o)ll? - C? ||E(C„|^o)||? ■ 

fc— n fc— n 

The same argument works with P_i(£o) replaced by Pi(£,o), and the result follows 
by applying Rosenthal's inequality and by noticing that — E(£_„ |.7"o)||g = 

iiEr=nft+i(&)ii 9 . 

To prove Remark 13 . 61 we apply Lemma 16.11 from the appendix with b n — 
log(n) and u n = ||-Po(£n)||2- We then get that 



E lo gHi^o(60ii 2 <c E^(Eii p o(a.) 112 ^ ~ 

n—1 n—1 v k—n 

Notice now that 

oo 

E 11^0(6)111 = l|E(en|^0)||i, 



< oo . 



and then 

Elog»||Po(UI| 2 <gElogn l|E( ^ o) " 2 

n—1 n=l 

The same argument works with -Po(£i) replaced by Po(£-i)- ° 
5.6 Proof of Theorem RT51 

For all j G Z, let c?j = X^ez-^M^)- Note that, if either Condition (a) or 
Condition (b) is satisfied, (dj)j^z is a sequence of martingale differences in L 2 . 
We set 

n 

Y k = E a ^/c-J and = E y fc > 

iez fe=i 

and apply Corollary 4 in Dedecker, Merlevede and Volny (2007). By taking into 
account Remark 13.51 we derive that under (|2ip . 



{Sn lT [nt],t € [0, 1]} converges in distribution in (D([0, l]),d) to J~E(dl\l)W 
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where W is a standard Brownian motion independent of I. It follows that in 
order to prove that {s~ 1 S[ nt \ 1 1 € [0, 1]} converges in distribution in (D([0, 1]), d) 

to <^E(d^\I)W it is sufficient to show that 

\\max 1<k<n \S k ~T k \\\ 2 , . 
► , as n — > oo . (37) 

Now for any n, let N be such that 2 A '~ 1 < n < 2 N . By using Remark 13.51 and 
the properties of the slowly varying function, we get that s n ~ s 2 n. So, the 
proof (|37p. is reduced to showing that 

II max 1<fc<2 ™ |5fc - T fc ||| 2 



s 2 « 



, as N -> oo . (38) 



We first prove that (|3"8")l holds under Condition (a). By using Corollary 12.11 
together with Lemma 12.11 we get that for any positive integer to, 

N 

|| max |5 fe -T fe ||| 2 < C x V \\Po(Zk)h 2 , a J2 v * (^(2^)) 1/2 

~ ~ |fc|>m L=0 

iV 

+c 2 m]>>- 1 (2^)) 1/2 , 

where g(a;) = :rlog Q (l + x). Noticing that for g _1 (x) ~ isgarpp^ as x g° es to 
infinity, by taking into account Remark 13.51 and the first part of Condition (|21[) 
we get that 

|| max \S k -T k \\\ 2 <Cs 2 N V ||Po(&)||* a a + Cme(N)s 2 N , (39) 

\<k<2 N t—*' 

\k\>m 

where e(N) — > as n — > oo. By using now (|3"9")) and letting first TV tend to 
infinity and next m tend to infinity, we derive (|38[) under Condition (a). 

We turn now to the proof of (|38[) under Condition (b). Taking m = m 2 L = 
2 L / 4 in Corollary 12.11 and using Lemma [2.11 with p = 2 and ^(x) = x, we get 
that 

llmaxKfc^lSfc-Tfcllla ^ 2 N / 



N/2 N 



m 2 L 

s 2 n ~ " s 2 n ^ 2 L / 2 



2 N/2 



N 



s 2 « ^ 2 L / 2 

\k\>m. 2 L 



By Remark 1 3. 5 1 we have that limjv^oo 2 Nj2 = 00 which together with the selec- 
tion of m 2 L imply that the first term in the right hand of the above inequality 
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tends to zero as n — > oo. Now, to treat the last term, we first fix a positive 
integer p and we write that 

Z>=0 |fc|>^2 L |^|^ m 2-L 



2 N/2 



JV 



s 2 « " 2 L / 2 

L= p |fe|>m 2 i 

Since limjv-,00 ^72 — 00 1 the nrs t term in the right-hand side of the above 
inequality tends to zero as n — > 00. To treat the second one, we notice that if 
N and p are large enough, 



2 N/2 



N N 



E PM&)ii a <tf£&T E 



L=p |fc|>m 2 i i=P fc|>m 2 i 

where h(n) — I ^™ = _„ ■ By tne nrs * P ar * °f Condition (|2T 



M2 L ) 

hm sup max , , ... < 00 . 

N ^P<L<N h(2 N ) 

It follows that for N and p large enough and by taking into account the selection 
of m 2 i , we get that 



N 

ES E \\p (t k )h<c Yl io g fc||p (a)ii 2 . 



2 N/2 

L=p fc >m, L |fc|>2P/ 4 



which converges to zero as p — > 00 by using Condition (b) . Hence starting from 
(|40|) and taking into account the previous considerations, we get that (l38|) holds 
under Condition (b). The proof of ([22]) is direct following the arguments used 
to derive (EH), o 



5.7 Proof of Comment 13.21 

The justification of this result is due to the following coboundary decomposition. 
Define 

^o = EE a ^-E E ( 41 ) 

e=i k=i e=a k=-oo 

Since condition |T]) implies that the sequence (£i)iez has a bounded spectral 
density, the random variable Zq is well defined in L 2 under under condition 
(H). Now 

OO OO OO OO 

Zq - Zq o T = 2J - Co £ afc ~ £0 E a_fc + E a - f & • 

f=i fe=i fe=i £=1 
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Whence, 

Mo + Z Q - ZqoT = a £o + a j£-j = x o ■ 

jez\{o} 

We derive that for any fe > 1, 

fe 

S k =A^ i + Z 1 -Z k+1 , (42) 

i=l 

where Zk — Z oTk. Since under (fTJ), the partial sums process {n^ 1 / 2 J2k=i £k,t £ 
[0, 1]} converges in distribution in D([0, 1]) to \/XW, with A = Yljez E(£o£j|2)) 
we just have to show that 

limsup P( max \Zk+i \ > ey/n) = 0, 

n^oo l<k<n 

which holds because Zo E L 2 (see the inequality (5.30) in Hall and Heyde 
(1980)). o 



6 Appendix 

6.1 Fact about series 

Lemma 6.1 Let (bj)j^ be a sequence of non-negative numbers such that for 
any a > 1, n a b n < K a X)fe=i k a ~ 1 bk, for some positive constant K a depending 
only on a. Then for any sequence of non-negative numbers (%)jgN and for any 
q > 1, the following inequality holds 

J2 ^ c i E 6 « ( - E u i ) 

n=l n=l \ k=n / 

where C q is a constant depending only on q. 

Proof. Let p be the positive number such that l/p+ 1/q = 1 and let a = 2/p. 
For this choice of a, let C' q = K a . We write 

oc oo n oo 

Y.bnUn <^E n ~" M «(E fefefc"- 1 ) < C;^6fefe a - 1 (^ n- a Un). 
n=l n=l fc=l fc=l n>k 

Then, Holder's inequality gives 

OO OO i I 

Y^Ku n <c q ^ a -\Y. -- ap ) (E <) 

ra=l fe=l n>fc n>fc 

and the result follows, o 
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